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(54) METHOD AND APPARATUS FOR DETECTING 
THREE-DIMENSIONAL INFORMATION 

(57) Abstract: 

PROBLEM TO BE SOLVED: To detect three-dimensional 
information of an object within the frame time of a 
video signal by an arrangement wherein at least one of 
brightness or image pickup gain varies with time and the 
distance to each point of the object is detected at a 
speed following up the frame time of the video signal in 
real time. 

SOLUTION: A signal generating section 1 delivers an 
illumination light modulation signal S1, an image pickup 
gain modulation signal S2, and a control signal S3, 
respectively to a projecting section 10, an image pickup 
section 1 1 and a signal processing section 7. The 
projecting section 10 illuminates an object with 
amplitude modulated illuminating light S6, the image 
pickup section 11 picks up the optical image of the 
object to produce image signals S41, S42 and the signal 
processing section 7 converts the image signals S41 , S42 
into a three-dimensional information signal S5. 
Brightness at each point of an optical image formed by 
focusing the reflected light from the object illuminated 
with amplitude modulated light contains distance 
information to that point. Consequently, distance 
information at each point of the object is obtained 
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two-dimensionally from the brightness obtained for each 
pixel of the image of the object and thereby 
three-dimensional information of the object can be 
detected. 
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BIT $ * m&-Ctfilh-f Z Jj&H J: CTIgE Sr««i" * „ 
Z< bi> --fitfttTSi bbi> iz&it-tZo fcjfa- 

a,t-v^ 0 z<7>z b zmm-rzzbx% 




1 

[is**n ft&nm&iG+zmw±?*m$iit: 

m.W&<r>'p% < til bbi> ug£ffc-f * <r>x 

[IS** 2 ] *N t b 4 (CSffci--5«SS:^'5: <tfc 

-^^-r a tg i & j: J/** 2 <7) ra a§ jt x-mm $p.fc mz 

«^t-E-it-?am 1 &£Xf&2<r>itm&t LT*Sf& 
L , w ti f, co5fc^f£ «• mm CISfS ?Ut#f 3h6B» H 
\zt>tz*) m% L tz.%£ I Hi. 2 COWS* £> , sri£«¥ 
flew #jft«>IB« 7 U-i»B#K|t-||B$K-Cii 

Hi- 4 ss-cBtm-f 4 ^ t t -r & is** i Eaco 
[is** 3 ] nirEis i !&m±<r>i®&i>m!si 1 1 i> ^ 

t t i-a m** 2 E®co&ftitf mmm-ftm. 
[is** 4 ] hjess i mwKonmimtsi 1 1 *> i-ig 

b Zft®. b -t h !S** 2 IEa<7)3!:^«1*iii*ffio 

[is**5] m-<n&m.x-m'x.nmzt>tz- J x5kit-t 

frI£«¥*S-^liJJ:a t ®2<n3lc:^St LT^fSL, Z 
tL * <r> *** t , 4? ft < t * 1 1 1 »c Sffci" 

£f?S 1 £ t VOL 2 ^Bfefa*^, Miet6^^«-.«<7)!il« 

iili-* ^ t £!imi:1-*|g** 1 %L8L<r>tLfcmmk\irt 

s. 

[is** 6 ] sriasg i *«t*if»6<i9H 1 1 1> icigsns 
t»±«^ u Mem 2 sfs?ij?#* j -ST-*>* w t «r»a 

b i"4 IS** 5 E*<r>j£*«««ai*ffi. 

is** 7 ] fria« i mmm&Uffm 1 1 i-isjjd 

U ffirESI 2*1t*l.f94<i*n ttt b *4¥ 

tt t "t-* If** 5 E*»£fM* 

[is** 8 ] mtzM&zM&m^n nu-i ^rart 

KtggtlHTT £ t «r»«t-r *li** 1 - 7 (7>v>-r*i.*> 

Etscosfcraffiffctii^au 

[If** 9] **#«£#W«*1*tti1-*8Kirc*o 

r, 

fc, «r«i, ffirE3r5eW«ISisXO f »«fiJ»<73^!5: < t 



(2) ^(32 0 0 0 - 1 2 1 3 3 9 
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*E*J5f*w£.««ffi» 7 U-ADHi:« 
BfH-CiEBi-C d -5 SSrmair S -5 J: -H- L£i Z b 

«&-*-* 5ims«ftai^s= 

[IS**. 10] mrE»Jt«* r . •?£5t<S^i-XoT2L ; IS 
■Ttt«: Sr«ATt»4 C t *»J6f*-4»** 9 

Ett«jt«t«*«aja«. 

[If**l 1] SfEJSTtSC^, 1£5Ug-?- 

io -tiztnvm%Km&t* maazzbivristb-tz 
is** 9 E««a*«*i»ai»iB. 

[IS** 12] Ht/Eiaf£SC*^ S9ES£¥ co 

imzLTrnzm^rZih-tj-tzMzm+b. «rea«* 

«t fitfEJSfS^?- 1 cora ICES * ffif£ffJ?^Sr.tlJfflH- 
4Cti'-C55^ — MtfS ^-->'Of /->7t{7 
-t. *ffiz.Z,Z k«:1#»t-r*JBjRJ|[-9E«wa:fltfl| 

m ft ail? So 

[In** 1 3 ] ffif ES-9-ttaff UC . IS** 2 - 8 ^ t » 
20 r^>E«<o^iSu£cfv»-ctirEtS^f^coS-.#.<75Siiffi€- 

tfa:-*--5 w t sr!f¥®t-t-«.is** 9 E$Eto5:f*tsm^aj 

SSiE. 
[%ig<D»Mffl&SifPJ] 
[0 0 0 1] 

[^fiOJgi-*ftfffS-»f] ^56^t±, ri^SftSfftiSfSU 

asup»3L, #tc, Bfef$<t-fco7 u-^mm-%Bfffir- 

30 iSt-lEd-t-S t cO"C*-So 
[0 0 0 2] 

[e£*«o|$fl¥] 56tfflt»rtt^*<nS€**-&wM±jaift:tS 
18 ftilJJ-*- 4 SfeiS r>t5.m b LTli, WTco^i£7) r *-5o 
[0 0 0 3] ( 1 ) 13 1 2 co J: n 

[0 0 0 4] (2) II 30J:tI:, SJE (1) «7fffi 
izis^x u--y-if-A«r 2*3cflt»Ujea£i-a wt tcj: 
40 i)«E^^&SCcoffi«t*2ifc7Cfl-I<c|f7ffl-1-4 < , 

[0 0 0 5] ( 3 ) H 1 4 eo J: -j U, iESiSH^-C.aa^ 
5fe$:^fiji-i t tit:, «f«K^cOB!r®US?.7i>fL/c -f ^ 
- v -f > r- > v 7 t -f T co -£tMg¥U» «: t iESSKa* 
-CSPi-*. «^f*-75«K,coR8t5e:«- L'>XT-*S(feL^7t 
^mt±, *£^«:t UVXS-eojBailCtt.C/'-ffiIHGCfflSr 
tLTV'4/L-«>, 0-->W>f >'>77<7i: ? 

*T./L-7fe^f«co t *, jtte*gfiJ?§co-32ft b (£fflco£--, ^«c^ 
co«A7)f3*ia$^4o -t-co/cio. u> Xfrc,*?3§.?&{zi>Z 
*£¥ffc<7)2Gfl-£^ft*fc47ctC 2 -X7CfiU l-i «J:t 7) f "C- 
50 5 4, wCOJMW.Scolffflli, !}?ra¥6-294868-?-^mco 



(3) 



[0 0 0 6] 

&*:*>ic«±, Jiie (2) <r>~fi&;<n±n K*fef-A«r 2* 
«Ejtc££-r**8d f **o JtK (3) 

*o -LIS (2) il/ (3) tt*tiW ? HW*feT-A*> 
Hoas-CRO w k 0 > £1tltBflfcaB 

w t * pt«b t i- * i cpsi E * ««■♦■ ^:tt* 20 
*. 

[0 0 0 8] 

LTWBU' w^jftW*WSO»ft«» 
»3 > ffiiS^f^^ffjgis J: tfl*«W»*>*fc < k i> 

CO &&« -7 u - a b$ r«i icigBsra -citss-*- * a 

KTBSaj-cS * -t i:=C:otv^o B*HBk k 4 UJEffc+ 30 

"« * ffi&fr t> f£0 & .ft ffitt * # * - k t&*T- S . 

[0 0 0 9] ±EO*f«li, »M»«>17I/-A»II| 
rtl-BSHfiro-Ct J:w». ttfcftX7-*>*fRtt 

[ooi o] *5s*^«*3r*«»«fcasaiK«±. ^fa^ 

*«f«SBk, *««**tt»»ft.fc^«*K**ft.* 

(4 rd-> a **><S#tt*tt< «?*JT' **>B»B| 

A t r 1 = 1 rk-gULT 50 



4fH2 000-121339 
4 

< k 4-^^ ? B#^i:<h tcjSftti 4^T* 

k t \z xitt *jvx<£ \± mmsm * n jab -r * c t -c, 

&f£SC t:Xo T«« $ «¥#<7>9M&<7> 2 *JE» 6* 
K lift*** * § ar * r oENMfffft*** 

[0011] 

^sTtg^a^gs i o; msnm*nmt-t 6 tc^ts-d: 

fSfi# S 4 1 iJ X OWIM!^ S 4 2 ^rlt^if S 5 

1 . ««5PJ»SS»^S 2 . ©JlS^i^S 3 *«ft£i-£fc 

[0 0 1 2] ■ J21T-C<±v HI 1 aXB*ffiv»fc*ftH(C& 

[00 1 3] B 2 is J: cnB 3 I§*Jg 3 U« 

*jtfWf«*B3!rtt«>H«»« (Wi»Bl) tRWi" 

si 1 1 -s t tm^m-rzo ::t t nwn. s 

<4*SK<mgStf£ (=2 Io/T) t«o (112 (b) U 
^$n.^> J: *> SjfcSB 1 0<bjtmJtP^f>S«d/fit 

4taa^M2d/voa^tots (t-2d/ 

v) fiO-t 9 USEfb-f^. *4B**J t = to^iS 

*t4ift*I*OKIt**:, B»«At «T) ^B«lt 
itf^J?^g^ g = go (>0) ktriSf^i-^k, 
wKSI.goit (1) ^"CR^ttio 

[0 0 14] 

[»1] 

(2) 5£-C|ES*x*o 
[0 0 15] 
[»2] 
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5 6 

(1) 3tt (2) 5t.fci) * * ISt3] 

* 7 r 

(3.) ftifJ » 5S [SC4] 

*4"('°~5**) - "' (4) 

?f>i:, I r =I n tt5tS=Io/ (T/2) ★ ★ [fiS] 

-H*-!**) * (5) 

fcfc'), (4) S:*fcl± (5) sS-t V tem d a***} -6-t*UX, *^*jft«J6*«»*«2*'3C<l'«HC»'!><i, « 
[0 0 16] ««£Mj(£"CJH913iT.*:tt^ [0 0 17] @3i:*tJ:-i(:, -j£i®<n*s;S I ri* I = I. 

±E« J: 5 &2r£-ett9ft*jl<tU WlolKW [0018] 
v>T**t«Si:«Lt (4) 5£i£l± (5) 5tt&ffl-£r20 [5*6] 



l»7] 



[»8] 



(8) 



<*-"-|«{<o-fa-*-)} -oo 

ffifSL-C, WtffcO&U^t- (8) ftiJtll (9) sSSria tlWtitttlC, t = tott = t„+T/2n2 

ffi+iL(i, 2 3t5E«JU»fefl.. B: ilM&t «T) <75F3^:'ttg=g < , (>0) tL 

[0 0 1 9] 04 K£-^T, IS*JS4 fc(6)5t.fc«K 

-GO) 



[&1 1] 



i„/ (t/2) -t n> 



[ai 2] 



(5) 



d -- «f„ 



I R 



2 u 41 + J? 

tSttffiStfc Ltd SrSEi-^ %03 ( 1 3 ) ft t 0 0 2 0] 

l±. t.,= T/4 i Lft»*« d ,.i = 0 [an] 
^ _ 1 1-.R 

"81 + i? 

3*fft£fi&flfcL-T. m%.<n^m^i^-r>^x (l l) 
(12) ***:«* (1 3.) *taffl-f*L«f, 10 

[0021] ±m%mmm itsxv2 <r>^mm.^m^ 

[0 0 2 2] 15 S-UTS 6 u£<*v>T, IS** 6 
r *8. - 
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(12) 



-03) 

;ag-f-& 0 !3 5 (a) <0 J: -? tct&ffltfm gri*g = U t ±&. 
ftH-tfgtin-f Z> X -5 fc i t=toi'b 

SB$IBI^.t «T) fe'ttaSI = IoT/^i'^^icf&Jt 

JjQSg (=2 g„/T) X$>Z><, EttdC«tJBI*vfc*9* 
<7) KJi%4q»US B I- JSS o T * *: B#^iS(*flJ ?# g - 
l±, 135 (b) izm-tio i-g-=U (to+2d/v) 

l±*tf> (14) ft-CfeStL*,, 
[0 0 2 3] 
Ittl 4] 

-.(14) 



*/ (4^d 3 ) a JfiOteSPl£*Bfc< fc*, «f£ 
*in#g£g = g,i-^el-l.TB$aiT' ^*>«B$fi8A t 
cc -c.ra.93 £fr-3o ^ixi m%.<r>m&* 



★ Irogrll, *W (1 5) ^X&ZtL&o 

[0 0 2 4] 



[Sfcl 5] 



( 1 4) fcj:^ (1 5) 5t.t»K 



* * [fk l 6 ] 



U(t n + 2d I v) 

8r 



(15) 



•(16) 



(16 ) 3CX •) 



♦ ♦ [til 7] 



fr =gofct4tU=go/ (T/2) -tO, * * [SfelS] 



"(17) 



(18) 



t »K (17) ft* £l± (IS) *£t>iEMd 
^fi.*. 1i&iBgll.teJ:U f 2a>#-6-fc|5]«ltc, ti&fcfr 

i:ovt (1 7) ft*£ii (18) ftSriaffl-rfur, « 



[0 0 2 5] B6i:ftJ:-5 U, tgffcftm g* J g = g o 

40 -u t tia^i-s^^-i-tiBi^co^jt-cs&aid* 5 **^ 



[0 0 2 5] 
[S19] 



(Aizd 2 ) 2 



[82 0] 



(19) 
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[Sc2 1] 

£ £»l-> gr -g.tt4k, * * I»2 2] 

jfe^fS«riSfStr, *«*>«H*t::on-C (2 1) 10 1117 (a) «)J:tI;, HftttMSSgtflStii 

£li (2 2) «tIfflt*Ltf. ttSfcfrjftOffiJH**** t- tot't- t..+ T/2«2IB, feB*HAt 

2*5C»U»**l. ***»tt»flMRt«Wl+*wi:4« «T) C«t5IK I = I „-C'<***i;»*-*-**-e* 

r .^ io 5«:«:!Hfl + 4. (15) *i (19)*iD, 

[0 0 2 7] *U, I7t:i^T. HUM17U**3£* 1&23] 

' /hi** U(t a +2d/v) ... (23) 



[SC2 4] 

. 1 / , go g ^ 

d «= — u - f n — 

2 V 0 U1*R) 

vTtSilt*i:, U=go/ (T/2) J:*), -ir 



«t-S33£i- -5> t , d <r>mm*£. tLXd 

t*«T-J So (2 6) 5£l±, t„=T/4 -ft- 

i i- a 

ififSLT, ©tf«(73S-i®35lwOV>-C (2 4) 5^ (2 5) 
3tife(± (2 6) 3t*affli-*il£, tt**SA«>E«* 

[002 9] ±.ia<75&^iasisuiivriafs<o!S 

v>T\ R_fc*»S£#<OI.goi:Ic.,t-gofiOi685, * 

£i R _ £r jS#> & fz &b I - g o t I r«t* 

fctt, Ri**4^oLg«k i.go^iftSSt^ftf* 

*»«X^«*»*^-t (S/N) it 

[0 0 3 0] HffitftJH IT, H 1 IzmZftZZ 

[0 0 3 1 1 18 (i, HI 1 US5$tt*j£5t« 1 0<nnt& 
M 1 0 a ^LT^io C^«^g(5 1 0 a 11, 

3 1 fc> »3t*^3 l^ffi»mu»mL-CEBtS*t, « 



...(24) 



* [&2 5] 

...(25) 

[0 0 2 8] 
[&2 6] 

.(25) 

&aR9§%4&ft3 0 t, rlxti^o ^M?3 1 <h L 
&o {fcoT. S li:J:'), flMliK 

^ i± / < * * «t«-jt * £\ *s* ;sa c S5 m *. u gsf t-t- 

[0032] H9 li* mi U?jt$ft.*i3:*a3 1 Ocogij^) 
^$&f0J 1 0 b ^Slti^o w^ft^tlB 1 0 b Its ^'8" 
*3 4 ta^****^ 3 SfeitfST-3 3^0£tiSt 

50 fe-£*»«%9%3 Ok, tlllitt^o »H6JEHB3 
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2 k L"C(±, jfcffitBS*«ft**»**S 
W-»^^Sr«ffl-*"«- fc* t- C & *° w <7)J23feac 1 0 b -C 
(i, gjfcS^S 3*fc*>€tt#3 4 **MBg£H»3 2 fc 

[0033] mi o a. mi u^3ix*««SB 1 

l^SftfltSLTV^, ~tf)igf£2El lit 
&WflUtJt«r**Lr*»«**JKi-*^>^4 k\ u 

*««-r*«*sHP6 k, »«*^6^m»**«*^ 

ai»i-* - fcWBTt84Bl«»«llil»2 2 k. fc**."t^ 

ga*#S2 0 «r^L-C«»)ft«t^*L-CU^ 0 fcJ3, ft 
Mfft(SiS***2 0 fc LTIt 77^<-7'l/-^l' 

7t^7 5W*Mi:»«SW.. -f >-v>f>f 
7T-f7 5^«MI8iit**l»li, 2 

So 

[0 0 3 4] r-FftM^->W>f>v77U5 
<0*WS?U»ll* Z<nY- h 2 1 uaiBTi-&«E-CSa 

it S 2 tr- h 2 l tzainji-^z k 

«• L^ f ot, *«W»KW«*S 2U*»K ««« 

[0 0 3 5] wOafgiCl 1 tJtEW#*«»» - C*« 
*f£SGl Hi, R.*^:c±R.*fcliR*ltff 
tir:^C2i 7V-^if:») 2 d 

A, atitsi ltn, ««*T-6*a*^>2«iS-ee» 

2 2 ^ J: ^TB&f&fl^S 4 1 tm&m^S 4 2 L 
T£litJ"t^o **v»lt IMS* lUOlSfSrtUftfS 
fg-^S 4 lfHfcS*(ft«*S 4 2HlC«»)«£Ttt«-CS 

[0 0 3 6] CLL**. ei i o^«flc*>«<SK i i it 
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UJtE-r* 2o^)«««-»«:iMIL-cas»-r**JSi: L 
[0 0 3 71 II lit Bl ^ftaSSS 7 <7)30£ff!! r 

79 -f *««*S 4 1 k*««*S 4 2 

umffl#ttEl»4 l^|BJ««**tt»)Krt»*i.fc*. 
10 «ffcl"^E«islK 1 t*«^E*i*2i: 

SE»2 *fc*>ttlflS 4 Sdsx'O'S 4 6 (liXlK&3(Bi& 
" 4 4i:Wj8*u R + *fcHR-4fcHRkE«dka f 

im$a^>o 4 ^ai^s 4 7 it 

#§B«HI»*2*3t»^**LfcB»*Wfll*-C*5, E 
d ^ttfc**^* ki" S 5 k LT&tJ 

ell**, mi i oflwt 7 1±. * 

[0 0 3 8] 

ft<o*$£i3 <fc CTOflWIf**^* < k t k k *> 

46. arfWtatMkflli-iwk^TS*- L^^t, * 

»aicjwi-r*wk^-c**« 
[mi] **wu«*3tf««**aassflE^-**JB»^ 

[9 2] SIJBilttlAsJicr— SO«]KOBW*k^^^tt 

kaMiwwg^wm*^****^, (b) na*aB^ 

40 t# g o» IB mti&B ifF LT^Zo 

[m 3] WJBW^isJicr— S^)<»S^BHW*k^^x« 

ffi^a^-t-^^^olll-C*^. (a) li.BMB#*>««I 
k«««f»g^»HIJEft*»«:»t, (b) tt«3tBi % 

[14] »^MisXcri**i-*»KoB|iii*k/<^^ 

^z£^tt^-r^^«6^m*c*o. (a) IIHIW*^** 
50 I k«f«¥«]»g^>«pMS£^t«^*^^- (b) 



13 

[0 5] fc^taJs-ttf-SwiSfl&fiJff i/ou*tt<7)« 
»0!H9ijfti:<n»**fe*t- J: 0 2 
miSLW-tZtzibtomvt)*)* (a) l±JH93jfc<n«J£ I 
fc««fUf»gOB#WSflSfe«*ji5U (b) lHaafcK* 
"a d £»tttft.fctt¥*j»*$>»Etf*tf>afiE I „fc Jft'fftfiJ 

SSrSlW-r*^rt(75ll-C*tJ . (a) i±ra^jtw«K I 
k«*fU1»g«»iai«ifcaOBS:*L, (b) I±j£jfc36* 

tf g <r>nt% ^LitWLB i m L x v » z> 0 
[S 7] mi&1mtoiTrfcfrlr&m®mi&£>**'X&<r> 

^ffi«rSl«i-'5^:«bOl3T*tK (a) i±HS^jt:W«S 

i tsmfw enftmmti&BzmL. (b) na^sc 
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[18] itt«ffiH 

[@9] tt»s»«riifl«ffiHSft*56#iff-f-£«*.4 
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